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\ / Multi-Part Looked-Up Table Fiel^^nd Its Use in Data Processing Operations 
[ involving Multiple Tabi^^rf a Relational Database 



5 BACKGROUND OF THE INVENTION 

Related Application 
The present application is a continuation-in-part application of U.S. Patent 
Application, number <to be assigned>, filed on October 25, 2001, and entitled 
10 "Multi-Part Looked-Up Table Fields and Its Use in Data Processing Operations 

involving Multiple Tables of a Relational Database". 



J 1 . Field of the Invention 

y. The present invention relates to the field of data processing. More 

1^15 specifically, the present invention relates to data processing techniques associated 
with data processing operations involving multiple tables of a relational database. 



J 2. Background Information 

In the course of the last two to three decades, relational database has 
20 arguably become the most widely used database model in database management. 
Along with the growing popularity of relational databases, the Structured Query 
Language (SQL) has become an indispensable tool for accessing data stored in 
tables of relational databases. 

However, as those skilled in the art would appreciate, virtually all data 
25 accesses of any meaningful application would require access and processing of 
data resided in multiple tables. Such accesses and processing require the 
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employment of the JOIN clause in a SQL statement (such as a SELECT, an 
INSERT, an UPDATE and a DELETE statement), joining tables of interest together. 
At times, in addition the employment of the JOIN clause, employment of a subquery 
is necessary for certain data grouping operations to be performed. Experience has 
shown that except for professional programmers experienced with SQL, few users 
fully understand or are totally comfortable with joining tables and/or employment of 
subquery. Unfortunately, the number of users having a need to access and process 
data dispersed in multiple tables in an unplanned manner far out number those who 
are skilled to comfortably do so. 

Recently, advances in integrated circuit, microprocessor, networking and 
communication technologies, have resulted in the popularization of the World Wide 
Web (WWW) and Web based applications, making available even a greater 
reservoir of data for access. In turn, the knowledge or skill gap problem discussed 
earlier is further magnified. 

Accordingly, an improved approach to accessing and processing data 
dispersed in multiple tables of relational databases, requiring lower data processing 
skill, is desired. 
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SUMMARY OF THE INVENTION 



In accordance with a first aspect, a software component is equipped to 
5 identify non-looked-up table fields and looked-up table fields with their rows to be 
grouped, and table fields having aggregate functions to be performed in their row 
values in a data processing statement, and in response, automatically includes with 
a SQL statement a subquery to create a grouped derivative table comprising the 
non-looked-up fields with their rows grouped and the aggregated fields with their row 
10 values aggregated, and one or more appropriate JOIN clauses joining one or more 
□ target tables from which the looked-up table fields are to be looked up with the 
£ grouped derivative table, effectively grouping the rows of the looked-up fields also. 
2 The SQL statement may e.g. be an INSERT, a SELECT, an UPDATE and a 
=5 DELETE statement. 

y 15 In one embodiment, the looked-up table fields are expressed in a multi-part 

;^ form comprising a first part corresponding to a look-up table field, and a second part 
:Sf corresponding to a looked-up table field, concatenated to the first part using a 
predetermined special character. 

In accordance with a second aspect, a software component is equipped to 
20 automatically expand table fields available for inclusion in a data processing 

operation to include table fields of a target table of a look-up table field, in response 
to the selection of the look-up table field, and to facilitate selection of aggregate 
function. 

In one embodiment, the second aspect is practiced in conjunction with the 
25 automatic inclusion of subquery and appropriate JOIN clauses to a SQL statement 
of the first aspect. 
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BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary embodiments, 
but not limitations, illustrated in the accompanying drawings in which like references 
denote similar elements, and in which: 

Figure 1 illustrates an overview of the present invention on the context of an 
application generator, in accordance with one embodiment; 

Figure 2 illustrates the concepts of look-up field and looked-up field, with the 
looked-up field referenced using the multi-part form of the present invention; 

Figure 3 illustrates the operational flow of the relevant aspects of the SQL 
generator of Fig 1 , incorporated with the support for the multi-part looked-up field of 
the present invention, in accordance with one embodiment; 

Figures 4a-4c illustrate an example user interface of an example data 
processing operation, utilizing the multi-part looked-up field of the present invention, 
in accordance with one example application; 

Figure 5 illustrates the operational flow of the relevant aspects of the input 
component of Fig. 1 in support of the user input interface of Fig. 4a-4b, in 
accordance with one embodiment; and 

Figure 6 illustrates an internal component view of a computer system 
suitable for use to practice the present invention, in accordance with one 
embodiment. 
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DETAILED DESCRIPTION OF THE INVENTION 



The present invention includes a multi-part format for specifying a looked-up 
5 table field, and software components equipped with logic in support of the looked-up 
table field, making it easier for a less skillful user to access and process, or generate 
applications to access and process data dispersed in multiple tables of a relational 
database, including performance of data grouping operations. 

For ease of understanding, the present invention will be primarily described in 
10 the context of an application generator, referencing the SQL SELECT statement, 
p However, the present invention is not so limited, and may be practiced with a number 
J of other SQL statements, such as the INSERT, UPDATE or DELETE statement, and 
in a variety of other contexts, e.g. a database query facility. Further, in the description 

E 

. k to follow, various aspects of the present invention will be described, specific numbers, 
U 13 materials and configurations will be set forth. However, the present invention may be 
practiced with only some or all aspects, and/or without some of these specific details. 

■ .! 

D In other instances, well-known features are omitted or simplified in order not to 

•zsssr 

m obscure the present invention. 

The description will be presented in terms of operations performed by a 
20 processor based device, using terms such as statements, tables, fields, determining, 
identifying, generating, and the like, consistent with the manner commonly employed 
by those skilled in the art to convey the substance of their work to others skilled in the 
art. As well understood by those skilled in the art, the quantities take the form of 
electrical, magnetic, or optical signals capable of being stored, transferred, combined, 
25 and othenA/ise manipulated through mechanical, electrical and/or optical components 
of the processor based device. Moreover, the term processor includes 



Bellew - Multi-Part Looked-Up 
Table Field and Its Use . . . 



Express Mail# EL051081697US 
ATA/mjt 




Attorney Docket Ref : 41017.P006x 

microprocessors, micro-controllers, digital signal processors, and the like, that are 
standalone, adjunct or embedded. 

Various operations will be described as multiple discrete steps in turn, in a 
manner that is most helpful in understanding the present invention, however, the 
5 order of description should not be construed as to imply that these operations are 
necessarily order dependent. In particular, these operations need not be performed 
in the order of presentation. 

The description repeatedly uses the phrase "in one embodiment", which 
ordinarily does not refer to the same embodiment, although it may. The terms 
10 "comprising", "including", "having", and the like, as used in the present application, are 
synonymous. 

Overview 

Referring now to Figure 1, wherein a block diagram illustrating an overview of 
,15 the present invention in the context of an application generator incorporated with the 

teachings of the present invention, in accordance with one embodiment, is shown, 
f As illustrated, application generator 102 includes in particular input component 104 
^ associated with a data processing operation, and SQL statement generator 106. In 

accordance with inputs received from an application developer user, application 
20 generator 102 generates applications 108. Included among applications 108 are SQL 
statements 110. SQL statements 110 include Create statements for use by 
applications 108 to create various tables 116 having a plurality of table fields (or 
simply fields) to store data, inside relational database 114, through relational 
database management system 112. SQL statements 110 also include SELECT 
25 statements for use by applications 108 to access created tables 1 16 for the stored 
data of the various fields (through relational database management system 112), 
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including data grouping operations if applicable. As needed, SQL statements 110 
may also include INSERT, UPDATE, DELETE and other statements. 

As will be described in more details below, in accordance with a first aspect of 
the present invention, SQL statement generator 106 is advantageously equipped to 
5 support looked-up table fields, expressed in the multi-part form of the present 
invention. The support includes in particular the automatic generation of the 
appropriate subquery to create a grouped derivative table comprising non-looked-up 
table fields with their rows grouped and aggregated fields with their row values 
aggregated, and the appropriate JOIN clauses joining target tables (from which fields 
10 are to be looked up) to the basis table or the grouped derivative table (effectively 
□ grouping the looked-up table fields). 

£ As will be also described in more details below, in accordance with a second 

2 aspect of the present invention, input component 104 of the data processing 
^5 operation is advantageously equipped to present fields of a table for selection by an 
pi 5 application developer user for inclusion in the data processing operation. Further, 

input component 104 is advantageously equipped to expand the list of fields available 
y for selection to include fields of a target table, if a selected field has been previously 
nj defined to be a look-up field with the aforementioned target table. Moreover, in one 
embodiment, input component 104 is advantageously equipped to facilitate selection 
20 of an aggregation operation for performance on row values of a selected field. The 
aggregation operation may be any one of a count function (COUNT), a minimum 
value identification function (MIN), a maximum value identification function (MAX), an 
average computation function (AVG), and a value summation function (SUM). 

Data processing operation may be any data processing operation known in art. 
25 An example of a data processing operation is report generation. Another example of 
a data processing operation is execution of a series of processing operations in the 
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form of a script file. Accordingly, input component 104, may be a component of a 
report generator, a component of a script editor, or other software components of the 
like. 

Further, in one embodiment, the second aspect is practiced in conjunction with 
the earlier described first aspect. That is, upon assisted an application developer 
user in selecting the fields, including looked-up fields and/or aggregation operations, 
for use in a data processing operation, SQL statements, such as SELECT, INSERT, 
UPDATE and DELETE statements, with appropriate subquery and JOIN clauses are 
generated. 

Accordingly, the SQL knowledge required of an application developer user of 
application generator 102, in particular, in the topic areas of data grouping and table 
joining, is advantageously reduced, thereby enhancing the usability of generator 102, 
as well as the productivity and experience of the application developer user. 

Except for the teachings of the present invention incorporated with input 
generator 104 and SQL statement generator 106, application generator 102 
represents a broad range of application generators known in the art, including in 
particular, known web application generators, e.g. the web application development 
facilities offered by Westside, Inc. of Seattle, WA, assignee of the present invention. 

Similarly, except of the fact that applications 108 being the beneficiary of the 
present invention, i.e. having selected ones of their SQL statements with their 
appropriate subqueries and JOIN clauses automatically generated, applications 108, 
relational database management system 112 and relational databases 114 all 
represent a wide range of these elements known in the art. In particular, relational 
database management system 112 may e.g. be the SQL Server offered by Microsoft, 
Inc. of Redmond, WA, Oracle Database Management System offered by Oracle Inc 
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of Redwood City, CA. Database2 (DB2) offered by IBM of Armonk, N.Y. or other 
relational database management systems (RDBMS) of the like. 



Multi-Part Looked-Up Field 
5 Turning now to Figure 2, wherein the multi-part looked-up table field of the 

present invention, and the relationship between the various parts to the basis and 
target tables, in accordance with one embodiment, is illustrated. As shown, for the 
embodiment, the multi-part looked-up table field of the present invention is expressed 
in two parts, a first part 222 corresponding to the look-up field in a basis table (also 
10 referred to as a foreign key of the table), and a second part corresponding to the 
O looked-up field 224 in a target table (also referred to as a primary key of the table), 
£ concatenated to first part 222 using a special character 226 (e.g. '':"). For examples, 
2 1 ) a "customer description" field (to be looked up) may be expressed under 

J the present invention in the form of customerJd:customer_description, 

Q 15 2) a "product description" field (to be looked up) may be expressed under the 

f7 present invention in the form of productJd:product_description, or 

pa 

y an "employee name" field (to be looked up) may be expressed under the present 
R-^ invention in the form of employeeJd:employee_name. As alluded to earlier and 
illustrated, the corresponding look-up field 204 (or foreign key) is a member of a 
20 "basis" table 202, whereas the corresponding looked-up field 214 (or primary key) is a 
member of a "target" table 204. Of course, each table 202 or 204 may comprise 
other fields 206 and 216. 

In alternate embodiments, other conventions, such as a convention involving 
more than two parts, may be practiced. Further, the "conjunction" may be other 
25 special characters, such as "-", "!", "@", "#", "$", "%", "&", "*", "|", "<", ">", or ".", 
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using selected combinations of multiple ones of these special characters, e.g. "<>", or 
even non-special characters. 

In one embodiment, multiple conjunctions are employed, with one conjunction, 
such as ":" denoting an Outer JOIN, and another conjunction such as "::" denoting an 
5 Inner JOIN. In other embodiments, additional conjunction denoting other types of 
joins, such as a Union JOIN may also be practiced. 

Further, in other embodiments, the multi-part looked-up table field of the 
present invention may be expressed in more than two parts, e.g. three parts, with a 
first part corresponding to the look-up field in a basis table, a second part 
10 corresponding to a first looked-up field in a first target table (which in turn is used as 
D look-up field), and a third part corresponding to a second looked-up field in a second 
i target table. As before, the different parts are concatenated to each other using a 
5 special character (e.g. ":"). For example, product Jd:categoryJd:category_name, 

specifying the looked-up field "category_name", to be looked up using a look-up field 
nl5 "categoryjd", which itself is looked up using a look-up field "product Jd". 



SQL Statement Generation 
Figure 3 illustrates the operation flow of the relevant aspects of SQL 
statement generator 106 of Fig. 1, in the context of a data access request, in 
20 accordance with one embodiment. The embodiment assumes SQL statement 

generator 106 receives a data access request statement in a non-SQL form as input. 
In one embodiment, the data access request statement has the syntax of 
Table Select {field name [, field name [...]]} 
where field name may be a conventional field name (e.g. userjd) or 
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a multi-part looked_up field name of the present invention (e.g. 
userjd:username), with or without an aggregation operation 
enumerated to be performed on row values of the field. 
However, as alluded to earlier, the present invention is not so limited, in other 
embodiments, the present invention may also be practiced with other SQL 
statements, such as an INSERT, an UPDATE and a DELETE statement, as well as 
other "request" statement syntaxes may also be practiced. In yet other embodiments, 
the substance of the request may also be communicated to SQL statement generator 
106 in a non-statement form, e.g. through a function call or other techniques of 
parameter passing. 

As illustrated in Fig. 3, for the embodiment, the relevant operation flow starts 
at operation 302, where generator 106 parses the input statement, e.g. to tokenize 
the elements in the input statement. Thereafter, for the embodiment, generator 106 
identifies table field or fields in the input statement, operation 304. Further, generator 
106 identifies whether the fields are "standard" (i.e. non-looked-up) table field or fields 
or the fields are looked-up fields, operation 306. In one embodiment, the 
determination is made based on a predetermined syntax of the multi-part looked-up 
field. For the embodiment, generator 106 also identifies whether aggregation 
operations are to be performed on row values of the enumerated fields, operation 
307. If at least one or more of the enumerated fields are to have their row values 
aggregated, the remaining non-looked-up and looked-up fields are considered to be 
grouped, with the grouping of the non-looked-up fields differentiated from the 
grouping of the looked-up fields. 

At blocks 308 and 310, generator 106 identifies the table (also referred to 
earlier as the basis table) of which the "standard" or non-looked-up field or fields are 
members, and the tables (also referred to earlier as the target tables) from which the 
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specified looked-up fields are to be looked up. In various embodiments, generator 
106 identifies the table membersiiip by accessing a data dictionary (not shown). In 
some of these embodiments, generator 106 maintains at least a work copy of the 
data dictionary. 

Thereafter, upon identifying the respective tables of which the standard (non- 
looked-up) and looked-up fields are members, as described earlier, generator 106 
automatically generates a functional equivalent SQL SELECT statement, 
enumerating the fields to be selected, a From clause, the basis table, and where 
applicable, the JOIN clauses and the target tables, as well as the associated ON 
clauses including the condition governing the joining of the rows of the joined tables, 
block 312. However, if one or more aggregation functions are specified for one or 
more corresponding fields, generator 106 further automatically generates a subquery 
to create a grouped derivative table comprising the grouped ones of the non-looked 
up fields with their row values grouped and the aggregated fields with their row values 
aggregated. The subquery itself is a SELECT statement enumerating the non- 
looked-up fields to be selected from the basis table, including the specified 
aggregation functions, for those fields to their row values aggregated, a FROM clause 
enumerating the basis table, and a GROUP BY clause enumerating the non-looked- 
up fields not specified to have aggregation operations perform on their row values. 
The subquery together with an AS clause enumerating an identifier of the grouped 
derivative table replaces the basis table in the earlier mentioned FROM clause of the 
SQL statement. That is, instead of joining the target tables to the basis table, the 
JOIN clauses join the target tables to the grouped derivative table, thereby also 
effectively grouping the looked-up table fields. 

For examples, 
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(a) for the input statement Table Select {studentjd. classjd:class_name, 
teacherjd:teacher_name, }, generator 106 generates SELECT 
enrollment.studentjd, class.class_name, teacher.teacher_name FROM 
enrollment LEFT OUTER JOIN class ON enrollment.classjd = 
class.classjd LEFT OUTER JOIN teacher ON enrollment.teacherjd = 
teacher.teacherjd; 

(b) for the input statement Table Select {order_no, productJd:product_name, 
product_id:categoryJd:category_name}, generator 106 generates SELECT 
orderJtems.order_no, products.product_name, categories.category_name 
FROM (orderjtems LEFT OUTER JOIN products ON 
orderjtems.productjd = products.productjd) LEFT OUTER JOIN 
categories ON products.categoryjd = categories.categoryjd 
("orderjtems", "products" and "categories" are the table names); 

(c) for the input statement Table Select {ta$k_name, assignedto:user_name, 
openedby:user_name} generator 106 generates SELECT 
tasks.task_name, users_1 .user_name, users_2.user_name FROM tasks 
LEFT OUTER JOIN users users_1 ON tasks.assignedto = users_1 .userjd 
LEFT OUTER JOIN users users_2 ON tasks.openedby = users_2. userjd; 
and 

(d) for the input statement Table Select {custjd:cust_name, custidicustjnfo, 
custjd, sum(order_value)} generator 106 generates SELECT 
customer. cust_name, customer. custjnfo, grouped Jable.custjd, 
grouped Jable.sum_value FROM (SELECT order.custjd, 
SUM(order.order_value) sum_value FROM order GROUP BY 
order.custjd) AS grouped Jable LEFT OUTER JOIN customer ON 
group Jable.custjd = customer.custjd. 
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Field Selection 

Figures 4a^c illustrate an example user interface for selecting fields and 
5 aggregation functions for a data processing operation, including usage of the multi- 
part looked-up field of the present invention, in accordance with one embodiment. 
The embodiment assumes in the course of table definition, a field may be designated 
as a look-up field, and each look-up field has a target table designated. Any one of a 
number of user interfaces and supporting logic may be practiced to facilitate such 
10 definition. The subject matter is beyond the scope of the present Invention, and since 

□ it is well within the ability of those skilled in the art, such definitional facilities will not 
be described. 

Figure 4a illustrates a first state 402a of this user interface, wherein for a list 
.h 404a of eligible table fields 406a is first initially presented for an application developer 

□ 15 user to select for inclusion in a data processing operation, which as earlier described, 
L i^^y 6-9- 3 report generation operation. Fields 406a may include in particular 

fields that are pre-defined look-up field 408a. For the embodiments, selected fields 
416a are "echoed" and displayed in area 414a. 

Figure 4b illustrates a second state 402b of this user interface, wherein upon 

20 selection of one of the look-up field 408a, the list 404b of eligible table fields 406b is 
expanded to include table fields of the designated target table of the selected look-up 
field. For the embodiment, the added table fields to be looked up are advantageously 
displayed using the multi-part looked-up field name of the present invention, e.g. look- 
up_field:lookedup_field. For the embodiment, selected fields 416b remained 

25 "echoed" and displayed in area 414b. 
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Figure 4c illustrates a third state 402c of this user interface, wherein upon 
denoting a desire to select an aggregation function on row values of a selected field 
(e.g. by right clicking on the selected field), a pop-up window 422c enumerating a 
number of aggregation operations is presented for user selection to have the selected 
5 aggregation operation performed on row values of the selected field. As illustrated, 
for the embodiment, the aggregation functions include the earlier mentioned COUNT, 
MIN, MAX, SUM and AVE functions. 

Figure 5 illustrates the operational flow of the relevant aspect of input 
component 104, in accordance with one embodiment. As illustrated and alluded to 
10 earlier, initially at block 502, input component 104 presents a first list of fields for 
D selection by an application developer user for inclusion in a data processing 

:S operation. Then input component 104 awaits for either a user selection of one of the 

W 

iO listed fields, a user request to select an aggregation function for a selected field or an 

^2 indication of termination of operation, blocks 504, 511 and 512. 
nl5 Upon receipt of a user selection, yes branch of block 504, input component 

: 104 determines if the selected field is a defined look-up field, block 506. If the 

p selected field is determined to be a defined look-up field, input component 104 

•■55: 

retrieves the fields of the pre-designated target table, add the retrieved fields to the 
list of fields available for user selection, block 510. Otherwise, input component 104 
20 simply notes the field selected, and the table of which the selected field is member, 
block 508. 

Upon receipt of a user request to specify an aggregation function for a 
selected field, input component 104 presents a pop-up window enumerated with a 
number of aggregation functions for selection by the user to specify an aggregation 
25 operation to be performed on the row values of the selected field, block 513. 
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In one embodiment, the collected information is subsequent provided to SQL 
generator 106 to automatically generate a functional equivalent SQL SELECT 
statement, including in particular, the appropriate subqueries, as well as JOIN and 
ON clauses. 

In one embodiment, the collected information is provided to SQL generator 
106 in the syntax of the earlier described Table Select statement. In another 
embodiment, the collected information is provided to SQL generator 106 through a 
function call. 

Example Comouter Svstem 
Figure 6 illustrates an example computer system suitable for use to practice 
the present invention in accordance with one embodiment. As shown, computer 
system 600 includes one or more processors 602 and system memory 604. 
Additionally, computer system 600 includes mass storage devices 606 (such as 
diskette, hard drive, CDROM and so forth), input/output devices 608 (such as 
keyboard, cursor control and so forth) and communication interfaces 610 (such as 
network interface cards, modems and so forth). The elements are coupled to each 
other via system bus 612, which represents one or more buses. In the case of 
multiple buses, they are bridged by one or more bus bridges (not shown). Each of 
these elements performs its conventional functions known in the art. In particular, 
system memory 604 and mass storage 606 are employed to store a working copy 
and a permanent copy of the programming instructions implementing the software 
components (e.g. input component 104 and/or SQL statement generator 106) 
incorporated with the teachings of the present invention. The permanent copy of the 
programming instructions may be loaded into mass storage 606 in the factory, or in 
the field, as described earlier, through a distribution medium (not shown) or through 
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communication interface 610 (from a distribution server (not sliown). The 
constitution of tliese elements 602-612 are known, and accordingly will not be 
further described. 

Conclusion and Epilog 
Thus, an improved method and apparatus for accessing and processing data 
disposed in multiple tables of a relational database has been described. While the 
present invention has been described in terms of the above illustrated embodiments, 
those skilled in the art will recognize that the invention is not limited to the 
embodiments described. The present invention can be practiced with modification 
and alteration within the spirit and scope of the appended claims. For example, the 
multi-part looked-up field name of the present invention may be used to improve the 
ease of use of other SQL statements and/or clauses, such as in addition to the 
aforementioned INSERT, UPDATE and DELETE statements, the WHERE, GROUP 
BY and SORT clauses. Thus, the description is to be regarded as illustrative instead 
of restrictive on the present invention. 
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